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COLOR IMAGE SEGMENTATION METHOD 

This is a non-provisional application claiming benefit of provisional application 
60/130,643 filed on April 23, 1999. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

5 The present invention relates to a color image segmentation method, and more 

particularly, to a color image segmentation method for segmenting a color image. 

2. Description of the Related Art 

The segmentation of a color image is a very important part of digital image processing 
and its applications. A first type of conventional color image segmentation method has a 
10 problem in that it is not easy to segment a color image containing texture. A second type of 
conventional color image segmentation method for performing an automatic segmentation 
does not perform well when used to process an input image containing noise. A third type of 
conventional color image segmentation method requires a user to prepare the image by 
manual segmentation. Though this third method produces satisfactory results even with 
15 respect to an input image containing noise, an automatic segmentation is not performed, 
therefore, this third method requires significant processing time. 

SUMMARY OF THE INVENTION 
To solve the above problems, it is an object of the present invention to provide a color 
image segmentation method capable of automatically segmenting a color image containing 
20 texture and performing well even with respect to an input image containing noise. 

It is another object of the present invention is to provide a color image processing 
method containing the color image segmentation method. 
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It is still another object of the present invention is to provide a medium in which a 
computer program performing the color image segmentation method is stored. 

Accordingly, to achieve the above objects, according to one aspect of the present 
invention, there is provided a color image segmentation method. The color image 
segmentation method comprises the steps of: (a) calculating a first value representing a 
degree of difference between the color of a pixel and peripheral pixels based on a plurality of 
pixel values of an input image; (b) obtaining a converted image by converting the first value 
into a value of a predetermined scale; and (c) segmenting the converted image. 

Preferably, the step (c) segments the converted image based on a region growing 
method. 

It is preferable that the color image segmentation method, prior to the step (a), further 
comprises the step of (p-a) quantizing pixel values of an image into a predetermined number 
of representative pixel values; wherein the pixel values are quantized pixel values. 

The representative pixel values preferably consist of 10-20 values. 

It is preferable that the color image segmentation method, prior to the step (a), further 
comprises the steps of: (p-a-1) defining a window containing a center pixel; and (p-a-2) 
calculating the first value representing the degree of difference from the color of peripheral 
pixels with respect to pixels in the defined window. 

It is also preferable that the step (a) comprises the steps of: (a-1) defining a window B 
which is centered at a pixel p and has a size of d x d where d is a positive integer preferably 
between 3 and 10, inclusive; and (a-2) classifying a pixel position z into a C number of 
classes when i is a number between 1 and C, and Z is a set of all pixels in the window B; and 
(a-3) obtaining a J-value with respect to each pixel in a class-map as: 



where mj is the average of positions of Nj data points in class Zj, 

The predetermined scale is preferably a gray scale having values between 0 and 255. 

In order to achieve the above object, according to another aspect of the present 
invention, there is provided a color image segmentation method. The color image 
segmentation method comprises the steps of: (a) quantizing pixel values of an image into a 
predetermined number of representative pixel values; (b) calculating a value representing a 
degree of difference between the color of pixels in a predetermined size window using 
quantized representative pixel values; (c) obtaining a converted image by converting the 
calculated value into a value of a predetermined scale; and (d) segmenting the converted 
image using a segmentation method based on a region growing method. 

In order to achieve another object, there is provided an object-based color image 
processing method for processing a color image according to a color image segmentation 
method. The color image segmentation method comprises the steps of: (a) calculating a 
predetermined value representing a degree of difference between a pixel and the color of 
peripheral pixels based on a plurality pixel values of an input image; (b) obtaining a 
converted image by converting a calculated value into a value of a predetermined scale; and 
(c) segmenting the converted image. 

In order to achieve still another object, there is provided a medium for storing 
program codes performing a color image segmentation method for segmenting a color image 
into a plurality of regions. The medium includes computer readable program means for: (a) 
quantizing pixel values of an image into a predetermined number of representative pixel 
values; (b) calculating a value representing a degree of difference between the color of pixels 



in a predetermined size window using quantized representative pixel values; (c) obtaining a 
converted image by converting a calculated value into a value of a predetermined scale; and 
(d) segmenting the converted image using a segmentation method based on a region growing 
method. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

The above objects and advantages of the present invention will become more apparent 
by describing in detail preferred embodiments thereof with reference to the attached drawings 
in which: 

FIG. 1 is a flowchart illustrating a color image segmentation method according to a 
10 preferred embodiment of the present invention; 

FIGS. 2A through 2C illustrate class-maps and J-values formed according to a color 
image segmentation method of FIG. 1; 

FIGS. 3A and 3B illustrate segmented class-maps; 

FIG. 4A illustrates one image frame of a "container" as a test image and a test image 
15 segmented by the color image segmentation method according to the present invention; 

FIG. 4B illustrates one image frame of a "foreman" as a test image and a test image 
segmented by the color image segmentation method according to the present invention; 

FIG. 4C illustrates one image frame of a "coast" as a test image and a test image 
segmented by the color image segmentation method according to the present invention; 
20 FIG. 4D illustrates one image frame of a "flower garden" as a test image and a test 

image segmented by the color image segmentation method according to the present 
invention; and 

FIG. 4E illustrates one image frame of a "mother and daughter" as a test image and a 
test image segmented by the color image segmentation method according to the present 
25 invention. 

4 



DETAILED DESCRIPTION OF THE INVENTION 
Referring to FIG. 1, which illustrates a flowchart illustrating a color image 
segmentation method according to a preferred embodiment of the present invention, a color 
image is input (step 102), and pixel values of an input image are quantized into several 
representative pixel values (step 104). In order to classify an image in natural scenes, the 
representative pixel values consist of 10-20 quantized values. In this embodiment, 
quantization is performed using three representative pixel values for convenience of 
explanation. Next, a class-map is formed by assigning labels corresponding to quantized 
representative pixel values (step 106). 

More preferably, a window centered at a pixel to be processed in an entire image is 
defined. That is, when d is a positive integer, preferably between 3 and 10 (inclusive), a 
window B which is centered at a pixel p or at approximately pixel p and has a size of d x d, is 
defined. Also, an assumption is made that i is a number between 1 and C, and Z is a set of all 
the pixels in the window B. An assumption is made that Z is classified into a C number of 
classes. In other words, Z is classified into C classes Zj, i=l...C. 

Also, an assumption is made that a specific class variable im,- is the average of 
positions of Ni data points in class Zj as: 
(equation 1) 




The more general counterpart of mt may be represented by m. 

Also, S T and S w are defined by: 
(equation 2) 

S T = ]>]||z -?k| 2 and 



(equation 3) 



respectively. 

Next, a J-value with respect to each pixel in a class-map is obtained (step 108). The 
J-value with respect to each pixel in the class-map is defined as follows: 
(equation 4) 



The J- values obtained by equation 4 are converted into a gray scale value between 0 and 255, 
so that a gray scale image having values and capable of being referred to as a J-image is 
obtained (step 110). The J-image has the same form as a three-dimensional topographic map 
containing valleys and mountains that actually represent region centers and region 
boundaries, respectively. 

Lastly, the J-image is segmented based on a region growing method (step 1 12). The 
region growing method is known to one of ordinary skill in the art as a method used for the 
segmentation of a digital image, therefore, an explanation thereof is not given. 

FIGS. 2 A through 2C illustrate class-maps and J-values formed according to a color 
image segmentation method of FIG. 1. The J-value at the center pixel is 1.720 in the class- 
map of FIG. 2A, and in the class-map of FIG. 2B, the J-value at the center pixel is 0, and in 
the class-map of FIG. 2C, the J-value at the center pixel is obtained as 0.855. In the class- 
map of FIG. 2A, in the case where pixels represented as + are located at the left of the center 
pixel, pixels represented as 0 are located at the right and upper portions relative to the center 
pixel, and pixels represented as * are located to the bottom lower portions relative to the 
center pixel, the pixels form regions most clearly. Here, the J-value is 1 .720, a relative large 




S T — S w 

s w 



value. By contrast, in the class-map of FIG. 2B, in the case where the pixels represented as 
+, the pixels represented as 0, and the pixels represented as * are uniformly distributed and do 
not readily form regions, the J- value is 0. Furthermore, in the class-map of FIG. 2C, in the 
case where the pixels represented as + are located at the left of the center pixel form regions, 
5 but the pixels represented as 0 and * to the right of the center pixel do not readily form 
regions, the J- value is 0.855. As is apparent from the previous discussion, the larger the J- 
value at the center pixel, the more likely that the pixel is near a region boundary. Therefore, 
a segmentation based on the region growing method by using this point can be performed. 
FIGS. 3A and 3B illustrate segmented class-maps. 

10 It is necessary to check whether segmentation has been performed well with respect to 

each region in the segmented class-maps and to represent the same as quantized values. For 
this purpose, when J k is the J-value obtained with respect to a k-region, and M k is the number 
of pixel points of a k-th region, and N is the total number of pixel points in the class-map, the 
averaged J-value is calculated as: 

15 (equation 5) 




The calculated values are represented as quantized values representative of whether a 
segmentation is performed well with respect to each region in the segmented class-maps or 
not. 

20 In the case of the segmented class-map shown in FIG. 3 A, J is 0, on the other hand, in 

the case of the segmented class-map shown in FIG. 3B, J is 0.05. That is, in the case of 
regions of a fixed number, especially in the case of better segmentation, the averaged J-value 
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is small. This occurs because the region contains a few uniformly distributed color classes in 
the case where a region is well segmented. Accordingly, the averaged J- value is small. 

FIG. 4A illustrates one image frame of a "container" as a test image and a test image 
segmented by the color image segmentation method according to the present invention. 
Referring to FIG. 4A, J of an image before segmentation is 0.232, but, J of the image after 
segmentation is 0.071 . Also, it is evident that regions in the test image are well segmented. 

FIG. 4B illustrates one image frame of a "foreman" as a test image and a test image 
segmented by the color image segmentation method according to the present invention. 
Referring to FIG. 4B, J of an image before segmentation is 0.238, but J of the image after 
segmentation is 0.105. Also, it is evident that regions in the test image are well segmented. 

FIG. 4C illustrates one image frame of a "coast" as a test image and a test image 
segmented by the color image segmentation method according to the present invention. 
Referring to FIG. 4C, J of an image before segmentation is 0.494, but J of the image after 
segmentation is 0.093. Also, it is evident that regions in the test image are well segmented. 

FIG. 4D illustrates one image frame of a "flower garden" as a test image and a test 
image segmented by the color image segmentation method according to the present 
invention. Referring to FIG. 4D, J of an image before segmentation is 0.435, but J of the 
image after segmentation is 0.088. Also, it is evident that regions in the test image are well 
segmented. 

FIG. 4E illustrates one image frame of a "mother and daughter" as a test image and a 
test image segmented by the color image segmentation method according to the present 
invention. Referring to FIG. 4E, J of an image before segmentation is 0.438, but J of the 
image after segmentation is 0.061. Also, it is evident that regions in the test image are well 
segmented. 



That is, as described referring to FIG. 4A through 4E, J of the image segmented by 
the color image segmentation method according to the present invention is smaller than J of 
the image before segmentation. 

In the above color image segmentation method according to the present invention, a 
robust segmentation is possible even when segmenting an image containing much noise or 
texture. Furthermore, an automatic segmentation is possible without user's assistance, such 
as segmentation performed manually by a user. Therefore, the segmentation can be 
performed rapidly. The color image segmentation method can be applied to object-based 
image processing such as that used in MPEG-7. 

In the above embodiment, the calculation of specific functions are explained as 
examples, however, this is only for purposes of explanation. The scope of the present 
invention defined in the appended claims is not limited to the embodiment, and it is obvious 
that one of ordinary skill in the art can use another modified function representing the degree 
of difference from the color of peripheral pixels. 

For instance, in equation 3, Sw may be represented by 

i=l zeZ, 

Furthermore, the above color image segmentation method can be embodied in a 
computer program. Codes and code segments comprising the program can be easily inferred 
by a skilled computer programmer in the art. Also, the program can be stored in computer 
readable media, read and executed by a computer, and it can thereby realize the color image 
processing method. The media can include magnetic media, optical media, and carrier 
waves, or other media used for machine-readable forms. 



As described above, according to the present invention, a color image can be 
automatically segmented without a user's assistance and is robust and effective even with 
respect to an input image containing noise. 
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What is claimed is : 

1 . A color image segmentation method for segmenting a color image into a 
plurality of regions, comprising the steps of : 

(a) calculating a first value representing a degree of difference between a pixel and 
peripheral pixels from the color of peripheral pixels based on a plurality of pixel values of an 

5 input image; 

(b) obtaining a converted image by converting the first value into a value of a 
predetermined scale; and 

(c) segmenting the converted image. 

2. The color image segmentation method according to claim 1, wherein the step 
(c) segments the converted image based on a region growing method. 

3. The color image segmentation method according to at least one of claim 1 or 
claim 2, wherein prior to the step (a), said method further comprises the step of (p-a) 
quantizing pixel values of the input image into a predetermined number of representative 
quanatized pixel values. 

4. The color image segmentation method according to claim 3, wherein the 
representative pixel values consist of 10-20 values. 

5. The color image segmentation method according to claim 1 or claim 2, 
wherein prior to the step (a), said method further comprises the steps of: 

(p-a-1) defining a window containing a center pixel; and 
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wherein said step (a) further comprises calculating a second value representing the 
degree of difference between a pixel and peripheral pixels from the color of peripheral pixels 
with respect to pixels in the defined window. 



6. The color image segmentation method according to claim 3, wherein prior to 
the step (a), said method further comprises the steps of: 

(p-a-1) defining a window containing a center pixel; and 

wherein said step (a) further comprises calculating a second value representing the 
degree of difference between a pixel and peripheral pixels from the color of peripheral pixels 
with respect to pixels in the defined window. 

7. The color image segmentation method according to claim 1 or claim 2, 
wherein the step (a) comprises the steps of: 

(a-1) defining a window which is centered at a pixel p and has a size of d x d when d 
is a positive integer, said window having a set of pixels Z; and 

(a-2) classifying a pixel position of each pixel of set Z into one of a C number of 
classes when i is a number between 1 and C; and 

(a-3) obtaining a J- value, as said first value, with respect to each pixel in a class-map 

as: 




S w 



where mi is an average of positions of Ni data points in class Zj, i=l to C, and 



s t = E k - HI 2 ^ ^i^-IE \\ z - »* 




8. The color image segmentation method according to claim 3, wherein the step 
(a) comprises the steps of: 

(a-1) defining a window which is centered at a pixel p and has a size of d x d when d 
is a positive integer, said window having a set of pixels Z; and 

(a-2) classifying a pixel position of each pixel of set Z into one of a C number of 
classes when i is a number between 1 and C; and 

(a-3) obtaining a J-value, as said first value, with respect to each pixel in a class-map 

as: 

J _S B _ S T -S W 
S w S w 

where m { is an average of positions of N, data points in class Z i5 i=l to C, and 

s r=z J* - »| 2 = i; s t = i; z \\z - m t i 2 

9. The color image segmentation method according to claim 4, wherein the step 
(a) comprises the steps of: 

(a-1) defining a window which is centered at a pixel p and has a size of d x d when d 
is a positive integer, said window having a set of pixels Z; and 

(a-2) classifying a pixel position of each pixel of set Z into one of a C number of 
classes when i is a number between 1 and C, and 

(a-3) obtaining a J-value, as said first value, with respect to each pixel in a class-map 

as: 
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10 where m; is an average of positions of Nj data points in class Zi, i=l to C, and 



S r = S f - 4 2 and S w =± Si =±Z \\z - m, || 2 



10. The color image segmentation method according to claim 5, wherein in said 
step (p-a-1), said window has a size of d x d when d is a positive integer, said window having 
a set of pixels Z, and the step (a) comprises the steps of: 

(a-1) classifying a pixel position of each pixel of set Z into one of a C number of 
5 classes when i is a number between 1 and C, and 

(a-2) obtaining a J-value, as said first value, with respect to each pixel in a class-map 

as: 



where m; as said second value is an average of positions of Ni data points in class Zi, i=l to 



1 1 . The color image segmentation method according to claim 6, wherein in said 
step (p-a-1), said window has a size of d x d when d is a positive integer, said window having 
a set of pixels Z, and the step (a) comprises the steps of: 

(a-1) classifying a pixel position of each pixel of set Z into one of a C number of 
5 classes when i is a number between 1 and C, and 




10 C, and 
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(a-2) obtaining a J-value, as said first value, with respect to each pixel in a class-map 

as: 

J _S B _ S T -S W 

s w s w 

where rxij as said second value, is an average of positions of Ni data points in class Zj, i=l to 
C, and 

12. The color image segmentation method according to claim 7, wherein d is an 
integer inclusive of and between 3 and 10. 

13. The color image segmentation method according to claim 8, wherein d is an 
integer inclusive of and between 3 and 10. 

14. The color image segmentation method according to claim 9, wherein d is an 
integer inclusive of and between 3 and 10. 

15. The color image segmentation method according to claim 1 0, wherein d is an 
integer inclusive of and between 3 and 10. 

16. The color image segmentation method according to claim 11, wherein d is an 
integer inclusive of and between 3 and 10. 
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17. The color image segmentation method according to at least one of claim 1 or 
claim 2, wherein the predetermined scale is a gray scale having values between 0 and 255. 

1 8. The color image segmentation method according to claim 3, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

19. The color image segmentation method according to claim 4, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

20. The color image segmentation method according to claim 5, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

21 . The color image segmentation method according to claim 6, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

22. The color image segmentation method according to claim 7, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

23. The color image segmentation method according to claim 8, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

24. The color image segmentation method according to claim 9, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 
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25. 

predetermined 



The color image segmentation method according to claim 10, wherein the 
scale is a gray scale having values between 0 and 255. 



26. The color image segmentation method according to claim 1 1 , wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

27. The color image segmentation method according to claim 12, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

28. The color image segmentation method according to claim 13, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

29. The color image segmentation method according to claim 14, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

30. The color image segmentation method according to claim 15, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

3 1 . The color image segmentation method according to claim 1 6, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

32. An object-based color image processing method for processing a color image 
according to a color image segmentation method, wherein the color image segmentation 
method comprises the steps of: 
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(a) calculating a first value representing a degree of difference between a pixel and 
peripheral pixels from the color of peripheral pixels based on a plurality of pixel values of an 
input image; 

(b) obtaining a converted image by converting said first value into a value of a 
predetermined scale; and 

(c) segmenting the converted image. 

33. The color image processing method according to claim 32, wherein the 
color image processing method complies with the MPEG-7 standard. 

34. A color image segmentation method for segmenting a color image into a 
plurality of regions, comprising the steps of: 

(a) quantizing pixel values of an image into a number of representative pixel values; 

(b) calculating a first value representing a degree of difference between a pixel and 
peripheral pixels from the color of pixels in a predetermined size window using quantized 
representative pixel values; 

(c) obtaining a converted image by converting said first value into a value of a 
predetermined scale; and 

(d) segmenting the converted image using a segmentation method based on a region 
growing method. 

35. The color image segmentation method according to claim 34, wherein the step 
(b) comprises the steps of: 

(b-1) defining a window B which is centered at a pixel p and has a size of d x d when 
d is a positive integer, said window having a set of pixels Z; and 
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(b-2) classifying a pixel position of each pixel of set Z into one of a C number of 
classes when i is a number between 1 and C, and 

(b-3) obtaining a J-value as said first value with respect to each pixel in a class-map 

as: 



36. The color image segmentation method according to claim 35, wherein d is an 
integer inclusive of between 3 and 10. 

37. The color image segmentation method according to one of claim 34 to claim 
36, wherein the predetermined scale is a gray scale having values between 0 and 255. 

38. A medium for storing program codes performing a color image segmentation 
method for segmenting a color image into a plurality of regions, wherein the medium 
comprises computer readable code means for: 

(a) quantizing pixel values of an image into a number of representative pixel values; 

(b) calculating a first value representing a degree of difference between a pixel and 
peripheral pixels from the color of pixels in a predetermined size window using quantized 
representative pixel values; 

(c) obtaining a converted image by converting said first value into a value of a 
predetermined scale; and 




S w 



where m.j is the average of positions of N; data points in class Zj, i=l to C, and 



s t =5>-H 2 and ^ =2X- =ZZH 
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(d) segmenting the converted image using a segmentation method based on a region 
growing method. 

39. The medium according to claim 38, wherein means (b) comprises computer 
readable code means for: 

(b-1) defining a window which is centered at a pixel p and has a size of d x d when d 
is a positive integer and Z is a set of all pixels in said window; and 

(b-2) classifying each pixel position of the set of pixels Z into one of a C number of 
classes when i is a number between 1 and C, and 

(b-3) obtaining a J-value, as said first value, with respect to each pixel in a class-map 

as: 



40. The medium according to claim 39, wherein d is set as an integer inclusive of 
and between 3 and 10. 



41. The medium according to one of claim 38 to claim 40, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 



42. The method according to claim 7 further comprising: 




where m { is the average of positions of N ; data points in class Z i? i=l to C, and 
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(d) checking for effectiveness of segmentation of step (c) according to a result of 




where J k is the J value of a region k, 

Mk is a number of pixel points in region k, and 
N is a total number of pixel points in the window. 

43. The medium of claim 38 further comprising a computer readable means for: 
(e) checking for effectiveness of segmentation of provided by means (d) according a 
result 

J = — YM k J k 

where J k is the J value of a region k, 

M k is a number of pixel points in region k, and 
N is a total number of pixel points in the window. 

44. The color image segmentation method according to claim 4, wherein prior to 
the step (a), said method further comprises the steps of: 

(p-a-1) defining a window containing a center pixel; and 

wherein said step (a) further comprises calculating a second value representing the 
degree of difference between a pixel and peripheral pixels from the color of peripheral pixels 
with respect to pixels in the defined window. 
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45. The color image segmentation method according to claim 44, wherein in said 
step (p-a-1), said window has a size of d x d when d is a positive integer, said window having 
a set of pixels Z, and the step (a) comprises the steps of: 

(a-1) classifying a pixel position of each pixel of set Z into one of a C number of 
classes when i is a number between 1 and C, and 

(a-2) obtaining a J-value, as said first value, with respect to each pixel in a class-map 

as: 

j _ $8 _ S T — S w 
S w S w 

where m, as said second value is an average of positions of Ni data points in class Z ; , i=l to 
C, and 

46. The color image segmentation method according to claim 45, wherein d is an 
integer inclusive of and between 3 and 10. 

47. The color image segmentation method according to claim 44, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

48. The color image segmentation method according to claim 45, wherein the 
predetermined scale is a gray scale having values between 0 and 255. 

49. The color image segmentation method according to claim 46, wherein the 

predetermined scale is a gray scale having values between 0 and 255. 
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Abstract of the Disclosure 
A color image segmentation method is provided. The color image segmentation 
method includes the steps of: (a) calculating a first value representing the degree of difference 
between a pixel and the color of peripheral pixels based a plurality of pixel values of an input 
image; (b) obtaining a converted image by converting the first calculated value into a value of 
a predetermined scale; and (c) segmenting the converted image. According to the color 
image segmentation method, an effective and an automatic segmentation is possible, and a 
segmentation speed is high even when segmenting an image containing much noise. 
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